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by 
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In  this  paper  we  present  sane  of  the  important  design  issues  for 
packet  switching  networks  with  both  satellite  and  terrestrial  components  -- 
which  we  call  mixed  media  packet  switching  networks.  Satellite  packet 
switching  has  considerable  promise  for  low  cost,  high  bandwidth  data 
communications .  However  there  is  inherent  high  delay  in  satellite  links 
which  do  not  appear  in  ground  links.  Therefore  a  mix  of  the  two 
comnunications  media  offers  the  advantages  of  low  cost/high  bandwidth 
together  with  low  delay  comnunications  where  required.  In  this  paper 
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Design  Issues  for  Mixed  Media  Packet  Switching  Networks 

by  D.  HUYMi,  H.  ROBAYASHI*  and  F.  F.  KUO** 

TEE  ALOHA  SYSTEM 
University  of  Hawaii 
Honolulu,  Hawaii 

INTRODUCTION 

In  1968  the  Advanced  Research  Projects  Agency  (ARPA)  of  the  U.  S.  Department 
of  Defense  began  implementation  of  a  computer  -coirmunication  network  which 
permits  the  interconnection  of  heterogeneous  computers  at  geographically 
distributed  centers  throughout  the  United  States.  This  network  has  come  to 
be  known  as  the  ARPANET  [1,2],  and  has  grown  from  the  initial  four  node  con¬ 
figuration  in  1969  to  almost  forty  nodes  (including  satellite  nodes  in  Hawaii, 
Norway,  and  London)  in  late  1974.  The  major  goal  of  ARPANET  is  to  achieve 
resource  sharing  among  the  network  users.  The  resources  to  be  shared  include 
not  only  programs,  but  also  unique  facilities  such  as  the  powerful  ILL! \t'  IV 
computer  and  large  global  weather  data  bases  that  are  economically  feasible 
when  widely  shared. 

The  ARPANET  employs  a  distributed  store -and -forward  packet -switching 
approach  that  is  much  better  suited  for  computer -communication  networks  than 
the  more  conventional  circuit-switching  approach.  Reasons  favoring  packet 
switching  include  lower  cost,  higher  capacity,  greater  reliability  and  minimal 
delay.  The  CCITT  (Comite  Consultatif  International  Telegraphique  et  Tele- 
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phonique),  an  international  standards  organization,  defines  a  packet  as  "a 
group  of  binary  digits  including  data  and  call  control  signals  which  is  switched 
as  a  composite  whole.  The  data,  call  control  signals  and  possibly  error 
control  information  are  arranged  in  a  specific  format." 

Multi-access  satellite  channels 

Communication  satellites  operating  in  packet  mode  are  becoming  increas¬ 
ingly  important  for  consideration  in  the  design  of  large  computer  communica¬ 
tion  networks.  In  particular,  most  possess  the  following  characteristics 
which  are  of  special  importance:  the  satellite’s  antenna  coverage  allows 
any  of  a  large  number  of  ground  stations  to  access  it  at  any  time  (multi -access) , 
and  its  transmissions  can  be  received  by  all  of  these  stations  at  all  times 
(broadcast) . 

Up  to  the  present,  packet  switched  computer  networks  have  mainly  utilized 
terrestrial  communications  links.  Recently,  Telenet  Communications  Corporation, 
one  of  the  new  value-added  carriers  [3]  announced  plans  to  offer  pulbic  packet 
switched  data  service  in  which  terrestrial  and  satellite  links  will  be  avail¬ 
able.  ARPA  has  also  been  planning  to  augment  its  terrestrial  links  with  satel¬ 
lite  communications  and  has  commissioned  several  satellite  IMPs  or  SIMPs  [4] 
to  be  built  by  Bolt  Beranek  and  Newman  Inc,  (BBN).  In  mid  1975,  BBN  and  the 
British  Post  Office  jointly  conducted  a  multi-access  satellite  experiment 
using  the  Atlantic  INTELSAT  IV  satellite  with  SIMPs  located  at  the  ETAM  ground 
station  in  the  U.  S.  and  the  Goonhilly  Downs  ground  station  in  England. 

The  basis  of  this  experiment  is  the  work  on  the  ALOHANET  of  THE  ALOHA  SYS¬ 
TEM  project  at  the  University  of  Hawaii  [5,6,7].  The  multiplexing  technique 
that  is  used  by  the  ALOHANET  is  a  multi-access  packet  switching  method  that 
has  come  to  be  known  as  the  ALOHA  technique. 
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Based  upon  the  ALOHA  multiplexing  method  or  variations  thereof,  a  number 
of  techniques  have  been  proposed  for  the  utilization  of  a  satellite  channel 
in  a  packet -switched  data  network  in  a  way  which  allows  all  stations  to  dyn¬ 
amically  share  the  channel  capacity  [8,9,10,11,12,13,14].  All  are  based  on 
the  division  of  the  channel  into  time  slots  approximately  equal  to  a  packet 
transmission  time.  The  approach  described  by  Roberts  [8]  and  Kleinrock  and 
Lam  in  [12,13]  makes  use  of  a  technique  called  "slotted  ALOHA  random  access" 
or  "slotted  ALOHA".  The  channel  capacity  of  a  slotted  ALOHA  channel  was 
estimated  to  be  1/e  =  36%  [8] . 

Goals  of  this  paper 

In  this  paper  we  will  examine  a  number  of  key  issues  in  the  design  of  a 
packet -switched  communication  network  composed  of  a  terrestrial  store-and -forward 
packet  switching  component  combined  with  a  multi-access/broadcast  satellite  as 
depicted  in  Figure  1. 

The  factors  involved  in  the  design  optimization  of  a  packet  switched 
network  are  [15]: 

•  Node  location  and  traffic  matrix 

•  Topology  of  links 

•  Capacity  of  links 

•  Routing 

•  Flow  control,  other  network  design,  etc. 

To  attempt  to  optimize  any  one  factor,  such  as  the  capacity  of  links,  it  is 
necessary  to  assume  that  the  factors  higher  in  the  list  must  be  given.  How¬ 
ever,  to  decide  optimum  choices  for  the  factors  high  on  the  list  may  require 
detailed  calculations  of  all  the  lower  ones.  Fortunately,  such  factors  as 
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node  location  are  usually  not  design  variables,  being  fixed  by  practical 
considerations.  Frank,  Frisch  and  Chou  [16]  have  developed  suboptimum 
procedures  for  the  topological  layout  of  a  packet  switched  network.  Thus 
we  will  concentrate  on  the  following  problems  in  our  paper. 

1.  Routing  of  packets  via  ground  or  satellite 

2.  Capacity  assignments  for  ground  and  satellite  channels 

3.  Retransmission  strategies 

In  this  paper  we  will  concentrate  on  the  discussion  of  design  issues  such 
as  throughput,  delay,  cost,  etc.,  rather  than  dwell  on  the  theoretical  develop¬ 
ment  of  the  design  equations  which  is  given  in  a  companion  paper  to  be 
published  elsewhere  [17] . 


THE  NETWORK  MODEL 


The  network  model  under  consideration  consists  of  a  terrestrial  store-and- 
forward  packet  switching  network  referred  to  here  as  the  ground  subnet,  and 
a  multi-access/broadcast  satellite  which  together  with  the  SIMP  ground  stations 
is  the  satellite  subnet. 

For  the  ground  subnet  we  will  use  the  model  given  in  the  paper  by  Crowther, 
et.  al.  [18],  and  will  reproduce  the  succint  definitions  of  network  terminology 
given  in  that  paper: 

Nodea.  The  nodes  of  the  network  are  real-time  computers,  with  limited 
storage  and  processing  resources,  which  perform  the  basic  packet -switching 
functions. 

Eoata .  The  Hosts  of  the  network  are  the  computers,  connected  to  nodes, 
which  are  the  providers  and  users  of  the  network  services. 

Lima .  The  lines  of  the  network  are  some  type  of  communications  circuit 
of  relatively  high  bandwidth  and  reasonably  low  error  rate. 
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Connectivity.  We  assume  a  general,  distributed  topology  in  which 
each  node  can  have  multiple  paths  to  other  nodes,  but  not  necessarily 
to  all  other  nodes.  Simple  networks  such  as  stars  or  rings  are  degen¬ 
erate  cases  of  the  general  topology  we  consider. 

Message.  The  unit  of  data  exchanged  between  source  Host  and  destina¬ 
tion  Host, 

Packet.  The  unit  of  data  exchanged  between  adjacent  nodes. 

Acknowledgement.  A  piece  of  control  information  returned  to  a  source 
to  indicate  successful  receipt  of  a  packet  or  message.  A  packet  acknow¬ 
ledgement  may  be  returned  from  an  adjacent  node  to  indicate  successful 
receipt  of  a  packet;  a  message  acknowledgement  may  be  returned  from  the 
destination  to  the  source  to  indicate  successful  receipt  of  a  message. 

Store  and  Forward  Subnetwork.  The  node  stores  a  copy  of  a  packet  when 
it  receives  one,  forwards  it  to  an  adjacent  node,  and  discards  its  copy 
only  on  receipt  of  an  acknowledgement  from  the  adjacent  node,  a  total 
storage  interval  of  much  less  than  a  second. 

Packet  Switching.  The  nodes  forward  packets  from  many  sources  to  many 
destinations  along  the  same  line,  multiplexing  the  use  of  the  line  at  a 
high  rate. 

Routing  Algorithm.  The  procedure  which  the  nodes  use  to  determine  which 
of  the  several  possible  paths  through  the  network  will  be  taken  by  a 
packet. 

For  the  satellite  subnet  we  use  the  finite  population  model  of  the  slotted 
ALOHA  channel  developed  by  Kleinrock  and  Lam  [13] ,  which  we  call  Scheme  1  ami  wc 
also  consider  a  multi-access  channel  model  in  which  there  is  no  retransmission 
via  satellite.  This  model  which  we  denote  as  MASTER  or  Scheme  ?.  is  described 
in  a  later  section  of  this  paper. 

The  combination  of  a  system  that  operates  in  contention  mode  (the 
satellite)  and  one  that  operates  in  queueing  mode  (the  terrestrial  store-and- 
forward  net)  into  an  overall  system  model  presents  many  interesting  problems . 
These  problems  are  mainly  due  to  the  fact  that  with  contention  systems  the 
throughput  increases  to  a  maximum  and  then  decreases  as  system  load  increases 
while  for  queueing  systems  the  throughput  increases  to  one  as  system  load 
increases  [13].  The  model  of  a  multi -access  s Lotted - AI/HIA  channel  is  typical 
of  a  contention  model,  and  to  use  the  channel  optimally  the  system  load  on 
the  channel  must  be  carefully  controlled.  We  have  tried  to  develop  an 
analytical  model  of  the  overall  system  so  that  we  may  predict  and  optimize  its 
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performance.  Our  network  model  thus  consists  of; 

A.  A  set  of  store -and -forward  IMP-like  devices  interconnected  by 
capacity  limited  ground  channels  (a  distributed  subnet) .  For  the 
sake  of  reliability  this  subnet  is  at  least  2-connected, 

B.  A  set  of  SIMP-like  devices  directly  connected  to  satellite  ground 
stations.  These  SIMPs  are  usually  geographically  scattered  and 
relatively  far  apart  from  each  other. 

C.  A  multi-access/broadcast  satellite  transponder  linking  all  SIMPs 
in  a  star  configuration. 

A  SIMP  is  usually  co- located  with  an  IMP  at  a  node  and  both  devices  have 
buffering  and  scheduling  capabilities.  We  assume  that  the  ground  net  is 
regionalized.  That  is,  the  ground  net  is  partitioned  into  regions.  Every 
region  has  a  SIMP  and  the  IMPs  in  that  particular  region  can  only  go  through 
one  and  only  one  SIMP.  The  regionalization  is  determined  by  the  closeness 
of  an  IMP  to  a  SIMP  in  terms  of  the  number  of  hops  and  the  distance  between 
them.  Such  a  structure  is  shown  in  Figure  1. 
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ROUTING 


With  a  mixed  media  network  the  issue  of  routing  is  a  major  concern.  With  two 
possible  courses  to  choose  from --one  via  satellite  and  one  via  ground,  the  issue 
is  to  choose  the  set  of  routes  so  as  to  minimize  the  overall  average  network 
delay.  The  tradeoffs  to  consider  are  these;  the  satellite  channel  has  an 
inherent  minimum  delay  of  .26  seconds.  However,  satellite  capacity  is  less 
costly  than  ground  channel  capacity  for  medium  to  long  distances,  and  there¬ 
fore  more  satellite  capacity  is  available  at  less  cost  than  comparable  facilities 
on  the  ground.  The  ground  channels  are  inherently  faster  than  the  satellite 
channel,  but  because  of  capacity  limitations,  are  subject  to  queueing  delays, 
which  combined  with  the  store -and -forward  nodal  processing  delays  may,  in 
heavy  traffic  situations,  result  in  larger  overall  delays  than  the  satellite 
delays.  To  summarize,  satellite  channels  have  greater  delays  but  also  more 
cost  effective  channel  bandwidth  than  ground  channels. 

The  routing  procedure  used  in  the  ARPANET  is  a  distributed  adaptive  al¬ 
gorithm  in  which  each  node  has  a  routing  table  which  is  periodically  updated 
with  minimum  distance  estimates  from  its  immediate  neighbors  [19] .  Unfortunately 
the  distributed  adaptive  algorithm  is  extremely  difficult  to  describe  analytic¬ 
ally  and  could  not  be  applied  to  our  analytical  model.  Instead  we  have  chosen 
a  deterministic  split  traffic  (bifurcated)  routing  strategy  [19]  which  because 
it  allows  traffic  to  flow  on  more  than  one  path  between  a  given  source -destination 
node  pair  gives  a  better  balance  than  a  fixed  routing  procedure.  It  should 
be  noted  that  our  analytical  model  does  not  require  any  specific  routing 
algorithm,  but  can  accommodate  any  routing  algorithm  that  can  be  modelled 
mathematically. 


#1 


:A 


I 


I 


1 


-9- 


D.  Huynh 


Optimal  routing  of  packets 

Using  the  network  model  of  Figure  1  the  main  problem  in  packet  routing  is  to 
route  packets  from  one  region  to  another  via  either  ground  or  satellite  links 
in  such  a  way  as  to  minimize  the  overall  average  delay  of  the  network.  Given 
the  topology  of  the  network  and  the  capacities  of  the  ground  and  satellite 
links,  we  assume  a  demand  matrix  [y. .]  where  y  . .  is  the  average  Poisson  input 

in  packets/sec  from  node  i  to  node  3.  Let  us  define  the  routing  index  g. . 

^<7 

as  the  fraction  of  y . .  sent  through  the  ground  net  and  let  g. .  =  1  -  g.  . 
be  the  fraction  of  y .  .  sent  through  the  satellite  net  by  first  routing  to 
the  SIMP  in  the  region  where  IMP  i  resides,  then  transmitting  through  the 
satellite  channel  to  the  SIMP  in  the  region  where  IMP  3  resides.  As  a  result, 
g. .  =  1  if  both  IMPs  i  and  3  are  in  the  same  region. 

Let  us  detine  T  as  being  the  overall  average  delay  of  the  network,  averaged 
over  all  source-destination  node  pairs  and  all  routes  dictated  by  the  routing 
algorithm.  The  optimal  routing  strategy  for  mixed  media  networks  can  be 
stated  as: 


min  T;  subject  to  {0  <_  g. .  <_  1  for  all  t,j} 

g.  .  V 

For  our  analysis,  we  define  the  following  notation: 


y  =  T  y  .  . 

.L  •  13 
1,3 


total  traffic  in  the  net 


t.  .  =  average  delay  for  a  packet  travelling  from  IMP  i  to  IMP  J 
13 


o(i)  -  index  of  the  region  (hence  that  of  the  corresponding 
SIMP)  to  which  IMP  i  belongs 
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t  ■  average  delay  for  a  packet  transmitted  from  one  SIMP  to 
another  via  the  satellite  channel 

T. .  =  overall  average  delay  for  a  packet  travelling  from  IMP  i 
3  to  IMP  j  (averaged  over  ground  and  satellite  links) 

We  can  readily  derive  the  following  relationships: 

For  the  ALOHA  scheme 


Tij  =  gijTij  +  +  Ts  +  xa(j)p  (1) 

and  T  =  -  7  y.  .T. . 

Y  +  y  J-  .gij^ ijT s 

For  the  MASTER  scheme,  in  order  to  obtain  an  expression  analogous  to 
Equations  (1)  and  (2),  we  further  introduce  the  notation: 

P  =  probability  that  a  packet  transmitted  from  SIMP  a  into 


the  satellite  channel  is  successful 


Then  we  obtain 


T. . 
*«7 


gijXij  +  gij^Tio(i)  +  Ts  +  Pa(i)xo(j)j  +  ^~Po(ipxo(i)j^ 


(3) 


and 


T  ~  Y  E  Y ;  •  • 

Y  ^3  13 

*  —  I  Y..{g..T.  .+g.  .[t.  ,.,+P  ,T  .+  (1-P  ,  .,)l  ,  ,  .]} 
v  13  *13 1  to(i)  0(1)  0(3)3  o(i)J  o(z), 7J 
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In  Equations  (2)  and  (4)  the  terms  with  g. .  represent  the  portion  of  traffic 

tj 

from  IMP  i  to  IMP  j  routed  entirely  through  the  ground  net  and  those  terms 

with  g . .  represent  the  portion  routed  from  node  i  to  the  regional  SIMP  aft ), 

from  a(i)  to  o(j),  the  regional  SIMP  in  which  IMP  j  resides  and  then  from 

o(j)  to  IMP  j .  Thus  even  in  the  satellite  routing,  there  is  some  associated 

ground  traffic  to  get  to  and  from  the  regional  SIMPs.  Oar  mathematical 

model  is  flexible  enough  to  permit  SIMPs  at  every  node,  and  if  this  were 

the  case,  obviously  the  t.  ...  and  t  , ...  terms  would  be  zero.  The  term  t  is 
7  va(v)  o(j)c  s 

derived  from  the  finite  population  model  of  a  slotted  ALOHA  channel  as  originally 
given  in  Lam  [13]  and  in  a  slightly  different  form  by  the  authors  [17] . 

Let  X^  be  the  traffic  on  link  Z.  We  can  derive  X^  as  a  function  of 
g^j-,  the  traffic  demand  y^ .  and  the  routing  algorithm.  Since  the  equation  is 
fairly  complex  we  will  not  give  it  here  but  refer  the  reader  to  a  companion 
paper  for  its  derivation  [17] .  Given  X^  and  neglecting  the  delay  due  to 
transmission  errors  and  nodal  processing  and  ground  propagation  time,  the 
average  delay  along  any  ground  link  can  be  described  by  the  M/M/1  queueing 
model  by  virtue  of  the  well-known  independence  assumption  and  Jackson's 
decomposition  theorem  [22] 
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on  the  satellite  channel,  i.e.. 


Xs-U. 


We  can  show  that  T  in  Equation  (6)  is  convex  with  respect  to  g . .  so  that 

we  can  obtain  a  minimum  overall  delay  by  varying  g . .  according  to  a  selected 

*'« 7 

optimization  algorithm.  The  optimum  choice  of  g . .  depends  also  upon  the 

t'J 

topology  of  the  network,  the  location  of  the  SIMPs,  the  capacities  of  the 
ground  and  satellite  links,  the  specific  terrestrial  routing  algorithm,  as 
well  as  the  traffic  demand  matrix  [y^.] ,  all  of  which  must  be  specified  in 
advance  of  the  optimization  computation. 

Since  the  optimum  selection  of  g . .  is  not  critically  dependent  upon  a 
particular  optimization  procedure,  we  used  the  algorithm  known  as  the  BOX 
COMPLEX  procedure  [20]  since  this  is  one  of  the  optimization  algorithms  which 
does  not  require  derivatives  of  the  objective  function. 

As  an  example,  consider  the  network  model  in  Figure  2  in  which  the  two 
regions  consist  of  nodes  (1,2, 3, 4}  and  nodes  {5, 6, 7, 8),  and  the  regional 
SIMPs  are  located  at  nodes  1  and  7.  The  traffic  demand  matrix  assumed  to  be 
uniform  with  y. .  =  20  packets/ sec.  i  /  j  and  y..  =  0  for  i  «  j.  The  average 
packet  lengths  is  assumed  to  be  512  bits  on  all  ground  channels.  The  packet 
length  on  the  satellite  channel  is  fixed  and  equals  1  K  bit.  The  ground  link 
capacities  are  all  assumed  to  be  =  50  K  bits/sec  and  the  satellite  capacity 
to  be  Cg  =  1500  K  bits/sec.  With  this  information  as  input  to  the  routing 
optimization  program,  the  inter -regional  g . .  are  computed  and  are  given  in 
Table  1.  Note  that  we  assume  g. .  *  1,  for  in  the  same  region. 


•  location  of  an  IMP 
®  location  of  an  IMP  and  a  SIMP 


Figure  2 

THE  NETWORK  MODEL 
CONSIDERED  IN  NUMERICAL  EXAMPLES 
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5 

destination 

6  7 

8 

1 

1 

0 

0 

0 

K  2 

.855 

.681 

0 

.706 

§  3 

1 

1 

0 

.315 

4 

1 

1 

0 

1 

Table  1 

VE  ROUTING  INDICES  FOR  TRAFFIC  FROM  REGION  1  TO  REGION  2 


Note:  The  Routing  Indices  for  traffic  from  Region  2  to  Region  1  are  symmetrical 
to  those  given  in  Table  1.  For  instance,  8g2“828"*7^’  872=®18=^;  etc’ 
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LINK  CAPACITY  ASSIGNMENTS 


In  the  packet  routing  studies  above  we  assume  that  the  ground  link 
capacities  are  given.  We  also  assume  as  given  the  capacity  of  the  satellite 
channel.  The  capacity  assignment  problem  is:  for  each  channel  it.  the  capacity 
C^  must  be  found  which  minimizes  the  total  average  message  delay  T.  The 
problem  is  most  difficult  if  the  capacities  must  be  chosen  from  a  discrete 
set  of  options.  Following  Kleinrock  [21]  we  assume  that  the  capacities  of 
ground  links  and  satellite  channel  are  continuous  variables  and  use  analytic 
procedures  involving  Lagrange  multipliers  to  obtain  C^.  A  general  discussion 
of  our  approach  follows. 

We  assume  as  given  the  topology  of  the  network  including  SIMP  locations. 
We  also  assume  a  given  demand  matrix  [y  •  •] •  Let  A  be  the  traffic  on  link  l. 

'I'd  Jc 

The  (continuous)  capacity  assignment  problem  can  be  formulated  as 


min  T  =  1  [  l 


\Tl  *  X5TS] 


subject  to  the  constraint  that  the  overall  budget  B  is  specified  where  B  is 


B=  l  \Ci 

£=1  *  * 


b  C 
s  s 


and  b^  and  bg  are  cost  functions  of  the  capacities  and  Cg  respectively. 

In  solving  the  capacity  assignment  problem,  we  need  to  know  the  total 
allowable  budget  and  unit  cost  of  ground  and  satellite  channel  capacities. 

We  assume  the  unit  cost  of  ground  cliunnel  capacities  are  the  same,  so  we  can 
normalize  all  costs  by  a  unit  cost  of  ground  channel  capacity.  In  obtaining 


-16- 


D.  Huynh 


the  following  results,  we  further  assume  a  ratio  of  1^  to  1A^  for  satellite 
and  ground  channel  capacity  costs,  i.e., 

1  unit  cost  of  _  10  unit  cost  of 

ground  channel  capacity  ~  satellite  channel  capacity 

Our  program  is  sufficiently  general  so  that  we  can  assume  any  ratio 
between  satellite  capacity  and  ground  capacity  costs.  Perhaps  a  more 
realistic  ratio  to  use  today  is  a  1  to  3  proportion. 

Without  going  into  the  details  of  the  capacity  assignment  optimization 
scheme,  which  is  quite  similar  to  the  work  of  KLeinrock  [21]  and  which  is 
described  elsewhere  [17] ,  let  us  discuss  the  computer  program  flow  chart  in 
Figure  3  which  combines  the  routing  and  capacity  assignment  algorithms  in  an 
overall  procedure.  The  program  first  obtains  a  solution  for  the  routing 
assignments  including  overall  average  delay  TD ,  the  routing  indices  g .  . 

K 

and  the  channel  traffic  rates  A  and  Then  with  the  A  and  A.  from  the 

si  si 

routing  calculations  and  with  a  given  total  budget  B  and  the  assumed  unit  costs 
of  satellite  and  ground  channel  capacities  bg  and  as  inputs  to  the  capacity 
assignment  routine,  we  obtain  the  capacity  assignments  and  {C^}  and  a  new 
figure  for  overall  average  delay  T^.  If  then  the  entire  procedure 

is  repeated  with  the  previously  computed  values  of  C  ,  {C0}  and  g. .  used  as 
input  to  the  routing  subroutine.  The  process  is  iterated  until  T^.=T^  to 
within  a  specified  accuracy  or  until  the  maximum  time  limit  allowed  for  the 
optimization  procedure  is  reached. 

Using  the  output  data  from  the  routing  subroutine  run  given  in  the 
previous  section,  the  iterative  cycle  is  carried  out  for  the  network  in 
Figure  2.  The  input  data  consists  of  the  original  demand  matrix,  initial 
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values  of  C^=50  K  bits/sec  and  Cs=1500  K  bits/sec  and  an  assumed  total 
budget  B  in  cost  units  and  b^=l  and  bs=0.1.  The  final  results  for 
{CA,Cs}  and  after  8  iterations  for  B  =  1,700,000  cost  units  are 

given  in  Table  2,  and  those  for  B  *  950,000  cost  units  after  4  iterations  are 
given  in  Table  3.  For  the  total  budget  B  =  1,500,000  the  minium  overall 
average  delay  was  T  =  .037  sec.  whereas  for  B  =  950,000,  T  =  1.435  secs. 

We  have  performed  a  number  of  runs  with  different  values  of  budget  B  and 
the  results  show  that  as  total  allowable  budget  increases  the  overall 
average  delay  decreases  as  seen  in  Figure  3.  Also  the  optimum  satellite 
capacity  decreases  and  the  ground  channel  capacities  increase  as  the  total 
allowable  budget  increases.  This  is  because  we  have  assumed  a  10  to  1 
ratio  between  the  cost  of  unit  ground  capacity  to  unit  satellite  capacity.  As 
the  total  budget  grows  we  have  more  money  to  spend  on  the  relatively  more 
expensive  ground  channel  capacities.  As  ground  channel  capacities  become  large, 
packets  tend  to  go  via  ground  subnet  since  the  minimum  satellite  propagation 
delay  is  high  (0.26  secs).  We  can  show  in  general  that  the  T  vs  B  curve 
is  a  hyperbola  and  have  derived  formulas  for  the  asymptote  S  which  are  given 
in  a  companion  paper  [17] . 

THE  MASTER  SCHEME 

In  this  section  we  will  describe  a  scheme  in  which  retransmission  traffic  from 
a  multi-access  channel  is  sent  via  the  ground  net.  This  scheme  will  be  denoted 
here  as  the  MASTER  (Multi-Access  Satellite  With  TErrestrial  Retransmission) 
plan.  Under  the  MASTER  plan,  the  up -link  of  the  satellite  channel  is  a 
slotted  multi-access  channel  and  the  down-link  is  a  broadcast  channel.  Un¬ 
like  slotted  ALOHA,  whenever  a  packet  collision  occurs  in  the  multi -access 
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Optimum  Traffic  Rates 

Optimum  Capacities 

( packe ts/seo) 

(K  bits/sec ) 

Satellite  Channel 

2.15 

15.966 

Ground  Channel  1 

67.95 

55.196 

2 

120.06 

88.238 

3 

119.80 

88.082 

4 

92.43 

70.967 

5 

159.54 

112.292 

6 

159.43 

112.226 

7 

92.46 

70.985 

8 

120.00 

88.201 

9 

119.81 

88.088 

10 

67.80 

55.097 

11 

67.81 

55.109 

12 

120.09 

88.259 

13 

119.67 

88.001 

14 

92.46 

70.984 

15 

159.55 

112.295 

16 

159.33 

112.163 

17 

92.46 

70.987 

18 

120.00 

88.203 

19 

119.71 

88.025 

20 

67.90 

55.165 

The  minimum  delay  -  .0369  seconds 


Table  2 

0PTIM14  TRAFFIC  RATES  AND  CHANNEL  CAPACITIES  FOR  B-1,700,000  COST  UNITS 
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Satellite  Channel 
Ground  Channel 


Optimum  Traffic  Rates 
(packets/ sec) 

Optimum  Capaciti- 
(K  bits /sec) 

Xl 

270.13 

511.770 

1 

93.61 

47.405 

2 

79.67 

40.391 

3 

88.29 

44.730 

4 

77.50 

39.298 

5 

81.71 

41.417 

6 

102.99 

52.125 

7 

77.61 

39.351 

8 

82.43 

41.780 

9 

86.86 

44.009 

10 

93.62 

47.413 

11 

91.26 

46.222 

12 

82.50 

41.815 

13 

85.94 

43.547 

14 

79.97 

40.541 

15 

82.07 

41.598 

16 

103.11 

52.185 

17 

79.97 

40.539 

18 

80.43 

40.773 

19 

89.34 

45.257 

20 

91.14 

46.166 

The  minimum  delay  -  1.435  seconds 


Table  3 

OPTIMM  TRAFFIC  RATES  AND  CHANNEL  CAPACITIES 


FOR  B=950,000  COST  UNITS 
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channel,  the  MASTER  scheme  does  not  use  the  satellite  channel  for  retransmis¬ 
sion  of  the  rejected  packet.  Instead  the  rejected  packet  is  sent  via  the 
ground  net  from  the  source  SIMP  directly  to  the  destination  IMP  without  I  lav¬ 
ing  to  first  go  to  its  regional  SIMP.  By  sending  retransmitted  packets  via 
the  ground  net,  overall  average  delay  can  be  reduced  significantly  especially 
if  the  traffic  on  the  satellite  channel  is  heavy.  Moreover,  the  MASTER  plan 
eliminates  all  possibilities  of  instabilities  that  might  occur  in  a  slotted 
ALOHA  channel  under  very  heavy  traffic  situations  [13] .  Thus  we  see  that 
the  MASTER  channel  has  no  retransmitted  packets.  Since  on  the  down-link 
broadcast  channel  each  SIMP  can  hear  its  own  transmissions,  if  a  packet 
collision  occurs,  the  source  SIMP  could  reroute  the  rejected  packet 
through  the  ground  net  without  waiting  for  an  acknowledgement  from  the 
destination  SIMP.  Moreover,  after  sending  a  packet,  a  SIMP  can  immediately 
send  again  in  the  next  slot  without  waiting  for  the  results  of  previous  trans¬ 
missions. 

Now  let  us  turn  our  attention  to  a  more  detailed  discussion  of  the  MASTER 
plan.  Consider  the  satellite  channel  model  depicted  in  Figure  4.  Let 
[pkts/sec]  be  the  average  input  rate  from  SIMP  o  to  the  satellite  channel.  The 
probability  q^  that  a  packet  will  be  transmitted  from  SIMP  o  in  a  given  time 
slot,  or  equivalently  the  traffic  rate  in  a  given  time  slot  is: 


where  Cg  [bits/sec]  is  satellite  channel  capacity  and  l/pg  [bits/sec]  is 
the  packet  length. 


#  •  • 


q,(l-P,)  dgO-Rj) 

Retransmit  via  Ground  Subnet 


Figure  4 

IBNET  MODEL  UNDER  MASTER 
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We  define  random  sequences  X^Ck)  and  Yq  (k)  as 

(  1  if  SIMP  a  transmits  in  time  slot  k 

x„00  -  { 

(  0  otherwise 

{1  if  SIMP  a  successfully  transmits  in  time  slot  k 
0  if  otherwise  (i.e.,  no  transmission  or  collision) 

Then  it  follows  that 


By  assuming  that  the  streams  Xo(k)  from  different  SIMPs  are  independent 
we  readily  obtain 

Pr  [Y  =1]  =  q  P 
1  a  J  lo  a 

where  P^=  n  q^  ,  with  q^=l-q  ,  is  the  probability  of  success  of  a  packet 
T^o  T  1 

from  SIMP  a.  The  normalized  throughput  S  or  successful  transmission  per  slot 
time,  of  the  satellite  channel  is  thus 

S  =  l  PrIYo=lJ 


=  l  q  P 

L  a 


Note  that  packets  from  SIMPs  traverse  the  satellite  channel  once  and  only  once 
under  this  operational  scheme .  If  we  assume  the  satellite  channel  transmission 
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errors  and  nodal  processing  delay  to  be  small,  and  buffer  storage  to  be  suf¬ 
ficiently  large,  then  the  average  delay  incurred  by  a  packet  when  going 
through  the  channel  can  be  found  by  using  response  time  formulation  of  an 
WD/1  queueing  system  plus  the  satellite  propagation  delay  x^^  of  approximately 
.26  secs.  The  result  of  a  deterministic  service  time  system  is  used,  since 
in  a  slotted  channel  all  packets  are  of  fixed  length,  any  messages  with  length 
less  than  a  specified  full  packet  size  are  filled  with  blank  cliaracters  to 
form  a  full  size  packet.  Thus  the  average  delay  experienced  by  a  packet 
travelling  from  SIMP  o  through  the  satellite  channel  is 

Ta  =  Tmin  +  ylT*1  +  2(\i  C°~-X  )} 

S  S  ^  S  S  cr 


The  overall  average  packet  delay  of  the  satellite  channel  ts  [secs/pkt]  can 
be  obtained  by  averaging  over  all  T^'s 


=  x 


min 


(7) 


where 


and 


% 
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It  can  be  shown  that  for  a  given  total  traffic  rate  A  -  £  A  [pkts/sec] 

s  a  a 

t  takes  on  its  minimum  when  A  =  A  /M,  for  all  a=l,2,...,M.  We  can  also  show 

S  CJ  S 

that  the  condition  £  q =  1  is  necessary  to  achieve  the  maximum  throughput  S. 

o 

From  these  conditions  we  immediately  see  that  the  best  throughput  delay  trade¬ 
off  is  attained  for  q^  =  1/M,  a=l,2,...,M. 

This  condition,  although  the  optimum  operating  point,  is  difficult  to 
attain,  since  the  traffic  rates  from  SIMPs  are  most  likely  not  equal.  It 
is  difficult  to  study  the  trade-off  for  cases  with  a  large  number  of  hetero¬ 
geneous  SIMPs.  We  can  obtain  some  understanding  of  how  S  varies  by  investi¬ 
gating  the  case  of  M=2.  For  this  case,  the  throughput  rate  of  the  satellite 
channel  is 


s  =  q1(i-q2)  ♦  q2(i-q1)  =  qi  +  q2  -  2q2q2  (g) 


A  plot  of  the  throughput  S  versus  the  traffic  rates  q^  and  q2  is  given  in 
Figure  5.  In  the  throughput  as  shown  in  Figure  5,  the  surface  takes  the 
form  of  a  saddle  with  the  valley  located  on  the  plane  q^=q2  which  includes 
the  S-axis  and  is  at  a  45°  angle  from  the  planes  q^=0  and  q2=0  (the  slashed, 
diagonal  plane  shown  in  Figure  5  and  ridge  located  on  the  plane  q1+q2=l  which 
is  perpendicular  to  the  plane  (qi=q2)  and  passes  by  upper -corner  end  points 
(1,0,1)  and  (0,1,1)  of  the  throughput  surface.  Note  that  the  condition 


qs  =  q}  +  q2  (9) 

corresponds  to  a  straight  line  of  slope  -1  on  q.-q^  plane.  As  stated  alxnc 

X  4* 

if 


qx  +  q2  -  qs  -  1 


(10) 
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we  obtain  the  maximum  boundary  of  the  throughput  S.  The  ridge  of  the  saddle 
surface  of  the  throughput  S  is  thus  the  maximum  boundary,  lor  this  simple 
case,  we  can  further  prove  that,  given  the  condition  in  liquation  (9J ,  S  attains 
its  minimum  for 

-  q2  UD 

which  is  the  line  with  slope  1  on  q^-q2  plane  (the  line  at  45°  degree  angle 
with  q^-axis  and  q^-axis) .  The  valley  of  the  saddle  surface  of  the  throughput 
is  thus  the  minimum  boundary.  Also,  the  overall  average  packet  delay,  -t  ,  of 
the  satellite  channel  for  m=2  case  is 

1  -  1  .  ♦  J-  (,^3-  ♦  ♦  — i-  (12) 

s  nun  2AS  \l-qj  1-qJ  Ufs 

Again,  the  delay  is  symmetrical  with  respect  to  q^  and  q2.  In 
Figure  (6)  we  show  the  level  curves  of  the  delay  surface  in  the  (q^ ,q7) 
plane.  Given  the  condition  in  Equation  (9)  the  delay  ts  reaches  its  minimum 
for  q1=q2.  The  minima  are  shown  by  a  dashed  line  intersecting  the  level 
curves . 

The  above  results  are  preliminary.  We  have  not  computed  numerical 
examples  for  the  MASTER  scheme.  These  will  be  given  in  a  companion  paper 
by  the  authors  [17] . 


constants 
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CONCLUSIONS 

In  this  paper  we  have  presented  sane  of  the  important  design  issues 
for  mixed  media  packet  switching  networks.  Satellite  packet  switching  has 
considerable  promise  for  low  cost,  high  bandwidth  data  communications. 
However  there  is  inherent  high  delay  in  satellite  links  which  do  not 
appear  in  ground  links.  Therefore  a  mix  of  the  two  communications  media 
seems  to  offer  the  best  of  both  worlds.  In  this  paper  we  have  examined 
a  number  of  trade  offs  which  offer  guidelines  for  the  design  and  optimum 
utilization  of  mixed  media  networks. 

We  have  introduced  a  new  communications  scheme  called  MASTER  (Hilti- 
Access  Satellite  with  Terrestial  Retransmission) .  We  believe  that  the 
MASTER  scheme  offers  significant  advantages  over  slotted  ALOHA  especially 
when  the  multi-access  satellite  channel  is  heavily  loaded. 

We  have  not  explored  the  possibility  of  sending  network  control 
information  along  the  ground  and  using  the  satellite  for  bulk  data 
transmission.  However  the  extension  is  logical  and  not  difficult  to 
analyze.  Another  logical  extension  of  the  MASTER  scheme  is  to  use  the 
satellite  channel  on  a  reservation  basis,  such  as  suggested  by  Crowther, 
et  al  [10] ,  Roberts  [11]  and  Binder  [14] ,  but  use  the  ground  channel  to 
set  up  reservations.  We  plan  to  explore  this  idea  in  a  subsequent  paper. 
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